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PREF ACE 


This thesi} is an analyiis of the preocedured for pro- 
motion of enlisted personnel of the United States Navy. It 
was undertaken to help determine whethe: the Navy is select- 
ing the best qualified men for advancement in rating. Although 
investigation was limited to the specific area of promotions 
to the rate of chief aviation machinist's mate, the results 
may be applied in a general way to the entire fleld of ad- 
vancements to chief petty officer rates. The elements of 
the promotion system are common to all ratings. 

This analysis of the Navy promotion system was confined 
to the mathematical efficiency of the system when it is used 
as a personnel selection tool. The effect of promotions on 
the morale of the enlisted men of the Navy was omitted - not 
because it was thought to be unimportant - but, on the con- 
trary, because 1¢ waz considered that the effect on morale 
was of at least equal importance and should be the subject 
of a separate stady. 

During preparation of this thesis, a number of persons 
gave liberally of their assistence and advice. I am indebted 
to many of the officers and men of Naval Alr Transport Squad- 
ron Forty-Pour for their ccoperation which made the study 
possible. Foremost among them are the commanding officer, 
Captain James H. Mills, Jr., U.S. Navy, and Lieutenant Willian 
J. Seott, U.S. Havy, the Assistant Perscomnel Officer. 


e434. 





To my faculuy advisor, Dr. James £. Curtis, Assiavarr 
Professor of Educasion, ctanford University, go my sincere 
thanks for generous devotion of his time and effort and for 
his valuable suggestions. 

For heipful assistance in obtaining data for the study 
I am indebted to members of the staff of the Bureau of Naval 
Personnel, particularly Captain Charles E. McCombs, U.S. Navy, 
and Dr. Everett @. Brundage of the Nesearch Division; Captain 
Ira E. Hobbs, U.S. Navy, Director of Enlisted Personnel; and 
Cormander A. L. Gevelin, U.S. Navy, Head of the Enlisted 
Promotions Section. Lieutenant Colonel Bryghte D. Godbold, 
Offiee of the Director of Personnel, U.S. Marine Corps, also 
fuenished valuable data and assistance. 

Ll wich to thank Commander Willard Y. Howell, U.S. Navy, 
@ classmate in the Naval Personnel Administration Course at 


stanford, for reviewing and criticizing the criginal draft. 
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CHAPTER I 
THE PROBLEM AND ITS SCOPE 


statement of the Problen 

In any organization, civilian or military, promotions 
are an important and continuing problem. In industry, labor 
and manecement have argued prometion for many years, with 
labor usually advocating promotion by straight seniority and 
management usually insisting on the righty to promote accord~ 
ing to its own judgment. Labor contends that promotion by 
management is too often promotion by favoritism, while manage- 
ment contends that promotion by sentlority is unfair to the 
petter men who must vemain behind those with less competence 
but more seniority. 

Although the Navy has no union problems, it does have 
& problem in the promotion of its enlisted men. The Navy 
recognised long ago that in order to bulld and maintain high 
morale it needed a system of enlisted promotions fair to all; 
a system based on what you know” rather than whom you know,” 
To meet its needs, it develoned a promotion system based 
primariLiy on professional qualifications but modified by 
length of service (seniority). 

Advancements in rating in the Navy are made in order 


from a promotion list established by service-wide professional 











e 
examinations. Relative standing? on the promotion list are 
determined by four factore: Examination grade, weighted 
73 per cent: total naval cervice, weighted 18 per cent; length 
of service in present rate, weighted 4.5 per cent; and awards 
for heroism and good conduct, weighted 4.5 per eent. 

The problem centers primarily on the weishtings given 

to these four factors. Many naval officers feel that the 
system gives too much weight to the pencil and paper profes- 
sional examination and toc little weight to seniority. There 
are those, however, whe feel that the entire system is in- 
valid and that it will not select the men best qualified for 
promotion, regardless of the weighting of the factors. The 
problem, then, can be reduced to three questions: 

lL. Does the Navy prometion system Gistinsuish between 
the men who are qualified and those who are not? 

2. Does the Navy promotion system establish the pro- 
motion list so that the best qualified men are ad- 
vanced in rating first? 

3. If the Navy promotion system does not now promote 
the best qualified men first, can the several fac- 
tors affecting relative standing on the promotion 
list be re-weighted so that the best qualified men 
will be promoted first? 


Need for the Study 
During the war years the rapidly expanding Navy had 


a vacancy for every qualified men. The problem was not one 





3 
of selection of the meet cu@lirved tuc, rather, ome of train- 
ine. The wartime reting suructure provided for very narrow 
specialization allowing ra.vid training and rapid advancement. 
the situation is now changed. The postwar rating struc- 
ture, vequiring broad qualifications, is in effect. Although 
the Navy is below its authorized peacetime strength, ite 
sise is decreasing and will probably continue to do so, 
Vacancies in the higher petty orficer brackets are becoming 
fewer and the number of candidates for these vacancies is 
increasing. The problem has become cne of personnel selec- 
tion and the promotion system must se tested to determine 
whether it is capable of cicking out the best men. If the 
yetem does not do an acceptable job of selection it is fair 


neither to the men to whom it is applied nor to the service 


@s a whole. 


Limitations of the Study 

The Navy promotion system encompasses sixty-two oeccupa-~ 
tional groups (ratings). Lack of time and facilities neces- 
sitated limiting this etudy to a single vating, that of 
aviation machinist's mate. This rating was chosen because: 
(1) personnel in the rating were readily available for study, 
(2) representative duties of the rating are performed both 
ashore and afloat and, (3) there are few vacancies for ad- 
vancement to chief petty officer in the rating. 

The study was further limited to the rate of chief avia- 


tion machinist's mate for the reason that advancement to the 





Pfices Bawet La here ConpaPacie > Prac Len 
to the Superviserr level in irviustry than exe acvencements 
to other Navy sradec. Promocion to pevty officer tnird, 
scomd, and first clasu correspond more nearly to "upgre 
ing’ in industry. 
The method of research required thet the study be con- 
fined to personnel stationed in a single naval cormand. 
The chie? aviation machinist': mates taking part in this 
scudy were all attached to Alr Transport Squedron Porty~Pour, 


Navel Air Station, Morfett Field, California, 


Definitions+ 

By usage in the Navy, “advancement” is applied to in- 
crease in grade for enlisted personnel while “promotion” is 
applied to increase in grade for officers. Whe distinction 
will not be made in this study, however, and the two words 
will be used synonomously. 

A “rating” is a name given to an occupation which re- 
quires basically related aptitudes, training, experience, 
kmowiedge and skilis, “Aviation machinict's mete” is e@ rate 
irs. 

A “pay grade” is a subdivision of a rating for pay pur- 
poses. A rating normally is composed of four pay srades: 
chief petty officer; netty officer, first class; petty officer, 


second elass; and petty officer, third class 





1. Bureau of Naval Personnel Manual, p. 144. 
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Dit eet 8 ce . ™ a ‘. Re a, . M 
Aviation machinist's matvee mainbain, rerair, 


test, inspect, adjust, and Stall aircraft en- 
gines (reciprocating and turbine) end accecsories, 
including propellers, carburetors, pumps, oi2 
soolers, and associated equipment. Onerate engines 
and auxiliary power plants for operational or 
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1. NavPers 180603. Washington: United States Government 
Printing Office, 1947, p. IX-1. 








THE NAVY PROMOTION SYSTEM 


Purpose of the Navy Promotion Systen 

The Hayy promotion system for enlisted perzormel was 
hullt around three fundemental principliea;: 

lL. Only those tully qualified to nold @ higher rate 


should be aclvanced,. 


Ne 


©, Bach man should have recurring opportunities to 


compete with others in his rate for advancement. 
3. The best qualified men should be advanced first. 
In regard to the first principle, the Bureau of Naval 
Personnel Manual! states: 


Personnel should be advanced in rating only 
if and when they are in all respects qualified to 
hold the higher rate to which advancement is to 
be effected. Advancements should not be made in 
the nature of rewards for faithful or extended servy- 
ice or simply because the minimum service require- 
ments have been fulfilled, without regard to the 
actual qualifications ef the individual. It is 
poor personnel administration to advance a person 
_* ‘i to a position which he is not qualified 
to fill. 


The Head of the Enlisted Promotions Section, Bureau of 
Naval Personnel, © expressed the same idea in somewhat dif- 


ferent terms: 





1. Op. eit., p. 144, 


2. A. L. Gebelin, “Promotions, Examinations and Changes in 
Rate and Rating of Enlisted Personnel, USN, p. l. 
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assume higher duties or upon those whose qualifica- 
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The second ang vhivad pranciples wor 
of Neval Personnel Circular Letter No. 155-40 which states: 
These instructions are Gdos@igned to srovide a 
controlled system by which each and every enlisted 
pergon will have recurrent opportvunitics to compete 
for advancement in the individual's chosen field 
of work .... tne determining factor in advanc- 
ing eligible candidates is the relative qualifica- 
tion of each candicace. 
Steps in Promotion® 
For advancement to a higher rate every Navy man must 
complete these eight basic steps to promotion: 
1. Meet certain requirements as to length of service. 
2. Meet certain requirements as to marks in conduct and 
in proficiency in rate. 
3. Complete satisfactorily the Navy training course 
for the next higher rate, when @ sultvabie course is avail- 
able. 
4. Complete satisfactorily a course of instruction at 


&@ service school, when such is required, 











1, “Advancement in Rating ~ Enlisted Personnel.” BuPers 
Circular Letter No. 155-46, August, 1946. 


2. Bureau of Naval Personnel Manual, p. 143. 
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Gh requivements of the next nigher rate. 


Promotion to Chief Aviation Machinisi's Mate 
in order to clarify the eight steps in the Navy promo- 
tion system, they wlll be discussed as they apply cpecifically 
to promotion from the rate of aviation machinisct's mate, 
first class, to chief aviation machinist's mate. The require- 
ments for length of service, marks in proficiency in rate, 
ana marks in conduct are common to all Navy ratings for ad- 
vancement to chie? cetty officer. 
step i, tength of Service. Te be cligible for acvance- 
ment oo chief petty officer, a man must have had at least 
venree years' service as a first class petty officer, eix 
months of which must have been sea duty. No total naval 
service has been specifically prescribed but in order to 
be advanced to pretty officer Plirat class under present 


reguiations,+ a man must have served in the Navy a total 








RED e =. 





1. "Advancement in Rating - Enlisted Personnel," SBuPers 
Circular Letter No. 155-48, August, 1945. 
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officer acting for the commanding officer. 

TO be eligibie for advancement to chief petty officer, 
&2 man must have received the following marks: in proficiency 
in rate, no mark less then 3.0 for the preceding two years 
and an average cf not less than 35.5 for the three years pre- 
ceding advancement; in conduct, no mark less than 3.0 and an 
average of not less than 3.5 for the two years preceding 
advancement. 

The interpretations of these marks are: 

Proficiency in rate 

+. ~ Competent, thoroughly reliable, atten- 


vive, energetic, forceful. Nov less 
than 3.5 in conduct. 
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1. Bureau of Naval Personnel Manual, p. 181. 
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Ibid., p. 183. 
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conduct 


4,0 - No offenses; exemplary in conduct, bear 
ins, 2d uniforma: seod influence on — 
Ship. 


.y) ~ Gonduct positively goed; no leave- 
preniiing offenses net nore then one 
minor offense in sobriety or of other 
nature. 


{ 4) 


3.90 + Minor offenses only, including one leave- 
preaking of less than 3 hours. 


When a mark less than 4.0 in conduct is assigned, an 
explanation must be entered in the service record. Conversely, 
the conduct mark must agree with the disciplinary entries in 
the record cf the same vertod. 

The marks in proficiency in rate, however, are not han- 


died in a simllarly objective manner. It is common practice 


$2 


to assigm all chief and firet class petty officers marks 

of 3.9 or 4.0 in proficiency in rate, regardless of actual 
service worth, so long as no disciplinary offenses have been 
committed during the marking period. 

The service records of fifteen chief aviation machinist's 
hates were examined to determine the correlation between 
quarterly narks and other ratings made by division officers. 
an total, the records of the fiftcen men contained cover one 


hundred quarterly marks. With two exceptions, every mark 


_- 
ee 
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a } . s ie ae a >. ae ae, cy _ 
fam t.0 - the two excenbions keine 2 3.c ond’: 5.9 assigned 


4 


ta as i i esis . ak % ¢ * nr aan aa re r 
to the game man in 194 /. \Gince thac time, however, all his 


® 


varke hed been 4.0 in upite of the fact that his divigion 
officer, three rating Sfriters, the versenmmél of fieer, aid 


vhe commanding officer declared him to be incompetent, of 


~ ae 


poor character, and of doubtful service worth. 


in his study cf enlisted men's quarterly marks, Godbo1at 


tated: “If a chief or firet clase petty officer has been 


S 


assigned a mark of 3.6 to 3.7 for a perlod in which he has 
violated no regulations, he is apt to consider this as an 
unsatisfactory mark.” 

It appears thet the marks requirements for proficiency 
in rate do not contribute to the Navy promotion system, nor 
Go they biock the unqualified man from advancement so long 
as his conduct record is acceptable, 

~tep 3. Navy Training Courses, It is the stated policy 
of the Navy Department to provide, insofar as ls practical, 

a training course for each rate.© In addition, the Depart- 
ment publishes “subject area courses” which include subject 
matter based on knowledge and akills which are required by 
more than cne rating. If a training course nas been published 


for the rate to which a man wishes to advance, he must complete 





1, 3B. D. Godbold, "Measurement and Evaluation of Enlisted 
Men in the U. $. Navy, pm. 31. Unpublished Master's 
thesis, Stanford University, California, L947. 


e. sureau of Naval Personnel Manual, p. 292. 


t@ 
it suecessfully berord being sOnBidered elipiole for promo- 
$2on. suceessful compietion of & trainings courne is deter~ 
mined ob: exanination. 

In April, 19438, the Havy pleced a new ooetwar rating 
structure in effect wnich did away with some of the old rat- 
ings, created several new ones, and changec the duties of 
many of the ratings which were retained. As @ result, new 
training courses are not yet availabie for many ratings, 
including that of aviation machinist's mate. 

Aviation machinist's mates, first class, are not, there- 
fore, required to oomplete a training course to be eligible 
for advancement but they are expected to complete pertinent 
parta of the following subject area courses:+ 

Alreraft Electrical Systems, NavPers 10315 

fireraft Hydraulie Equipment, NavPers 10332 

Aireraft Engines, NavPers 10334 


Aircraft Fuel Systems, NavPers 10335 


im 


Aircraft Propellers, NavPers 10336 

Fiight Engineering, NavPers 10395 

In addition, aviation machinist's mates, like all candi- 
dates for advancement to the chief petty officer srade, must 


have completed the “General Training Course for Petty Officers 


ic and Chief Petty Officers." 








1. “Trainines Publications Available for the Postwar En- 
listed Rating Structure. BuPrers Circular Letter No, 
6-48, January, 1948. 
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Practical Facbors. Practical vactore are 





those qualifications which are pest cGevemained oy observa~ 

tion of the candidate in situations that require a demonstra- 
¢ion of his knowledge, skill, and ability under actual oz 
gimulaved working conditions." Practical factors are included 
under ooth the milivary and the professional requirements for 
advancement in rating. 

The practical factors under military requirements for 
promotion to chief petty officer raves are basically the sane 
for ail ratings. They include such iteme as leadership, 
division duciesc, inectruction of personnel by on-the-job train-~ 
ing methods, infantry drill, senvry duties, and ship and 
aircrart recognition. 

rractieal factors under professionali qualification: 
for promovion to chief aviation machinist's mate are assigned 
in the following areas:© 

Use of hand and power-driven tools. 


se of measuring instruments. 














ET ag Te 


i. Manual of Qualifications for Advancement in Rating 
Navrers 10068, p. iv. ; 


2. Ibid., DD. ixX-1 _ Ix-4, 
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fiosvart engine installation, maintenanse, and 
overhaul. 


Propeller installation, service, and repair. 
Carburetor maintenance and repair. 
instrument and accessory repair and service, 
Flight engineering. 

oafety precautions. 


Records and reports i ow - to aircraft engine 
operation, service, and repair. 


oupervicion anc training of personel. 

rractical factors are non-competitive, and no marks are 
assigned, but the service record of the candidate must show 
that he has completecé the practical factors for the next 
higher pete before he is ecligibie to take the professional 
examination for prouoticon. 

Caveful administration of the practical factor require- 
ments would strengthen the promotion system by motivating 
candidates for advancement vo learn, and by weeding out some 
or the obviously unqualiriea men. in practice, however, the 
administration of practical factors is generally lax. The 
feeling seems Co be that nolding a petty orficer rate is con~ 
clusive evidence thet a man is qualified in all the practical 
factors of the rating. This feeling is especiaily true to- 
ward the higher petty officer grades. 
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ih CORNl cut om 
LES , Gepelin’ states: 
Peior to becoming eligdbie ror advancement in 
rating an individual ts required to be recommended 

ror that Nigher vate by hie commanding officer. 

Naturally the commanding officer must take the recom- 

mondation of officers and petty crficers immediately 

over the individual concerned. Irrespective of 

having met all other eligibility requirements an 

individual who is not considered by competent au- 

thority to be able to perform the duties of the 

hicher rate, if successful in examination, should 

not be cecormended by his commending officer until 

such time as he is considered qualified. 

At first glance this appears to be a statement of sound 
policy; actually, it is inconsistent. If a candidate for 
advancement to chief aviation machinist's mate has “met all 
other eligibility requirements,” his quarterly marks must 
have averaged 3.5 for the past three years. A mark of 3.5 
in proficiency in rate means, “competent and qualified in 
all duties of rate; has qualities sufficient to justify ad- 
vancenent." To deny a man, otherwise eligible, the oppor- 
tunity to compete for advancement by withholding his recom- 
mendation places the commanding officer in an untenable posi-~- 
tion. Even though it is widely recognized that quarterly 
marks do not reflect true estimates of abilities, commanding 
officers feel bound by them and rarely, if ever, withhold 


their recommendations. 





ee 





1. Gebelin, op. cit,, pp. 3-4. 
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nin Mijicary Requirements. In con- 





junction with the prove¢csional examination, ail candidates 
for advancement to chief bevty orPleer rates are given a 
written examination based on tne General Training Course 
for Petty Officers lc and Chief Petty Officers.” Although 
the examination is non-competitive, each candidate must make 
ascore of at least 2.5 based con a scale of O to 4.0. 

ine examination is objective, consisting of multiple 
choice questions in such areas as military etiquette, seaman- 
ship, safety precautions, fire fighting, security and accounta- 
bility of classified matter and government property, and 
general aviation information. The military requirements 
examination is not difficult; men who have studied the trein- 
ing course usually have no difficulty in passing it. 

Step &. Professional Examination. The final step in 
the promotion ladder is the written professional examination. 
Yor advancement to chief petty officer rates, the examinations 
are service-wide and competitive. Other factors being equal, 
the man making the highest score on the exarination will be 
advanced first. Only those scoring 2.5 or higher are con- 
sidered for advancement. 


The Manual of Qualifications for Advancement in Rating! 





prescribes in detail the subjects to be covered by the pro- 


fessional examination for each Navy rate. Candidates for 








1. Op. ctt., pp. Ik-4 - Ix-6. 
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advancenent to chief aviation machinist's mate are examined 
in the following general areas: 

Tools and measuring instruments. 

Airplane handling and checking. 

Aircraft engines. 

Airvervaft propellers. 

Carburetors and fuel systems. 

Instruments and accessories. 

Mathematics. 

Aireraft construction. 

Fiight operations. 

safety precautions. 

Records and reports. 

Publications. 

Aviation organization. 

The professional examinations are constructed and dis- 
tributed by the Bureau of Naval Personnel. The completed 
examinations are returned to the Bureau for grading and com- 
putation of multiple scores.* The Chief of Naval Personnel 
authorizes advancement of the men having the highest multiple 
scores to fill actual and expected vacancies. At present, 


professional examinations are held annually. 





@®. Multiple scores consist of professional examination scores 
plus eredits for total naval service, service in present 
rate, and awards for hercism end food conduct. Multiple 
computation is explained in detail in Chapter VIII. 





reas OF Invectigation 

Although the Navy promotion system consists of eight 
steps, it anmpears that only two of them have any real effect 
in determining the qualifications of the candidates and their 
standing on the promotion list. The two significant steps 
are; length of service, including total service and service 
in pate; and score on the professional examination. 

The oniy other significant item in the promotion systen 
is the high standard of conduct. Bed conduct, even though 
the offenses are relatively minor, wiil biock a man's pro- 
motion. 

In order to study the Navy promotion system as it actu- 
ally operates, the areas of investigation may be limited to 
total naval service, service in present rate, awards, and the 
professional examination. This study was so limited, except 
that some investigation was made in the area of Navy vest 
battery scores and their relationship to professional examina- 


Gion grades and promotability. 


Related Studies 


The most recent study in the field of enlisted military 
promotions was made by Godboidt for che United States Harine 


Corps. At present, staff noncomaissioned officers of the 





LD ae 








i. B.D, Gedbold, "Recomaendat ions for Chanses in Procedures 
for Promotion to Staff MNonsommissioned Officer Grades." 
Unpublisned momorandum to tae Director of Fersgunnel, U.S. 
Marine Corps, Arlington, Va., February 15, 1950. 
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Marine Corps are selected for praorotion by a board of officers 
in the Corps Headquarters. ‘The ULoard considers the records 
of marines eligible for premution in order of seniority, 
rejecting those nov considered qualified. selections are 
iade from the seniority list unvill vacancies are filled or 
until all elicible candidates have been considered. 

In lieu of considering the marines candidates in order 
of their seniority, Godbold recommended tnat they be consid- 
ered in order of a composite score computed from merit rate 
ines, score on a General Military Subjects test, time in 
grade, and time in service. He further recommended that 
these elements be weighted: merit ratings, 48 per cent; 
General Military Subjects test, 24 per cent; time in grade, 
el per cent; and time in service, 4 per cent. 

The weights recommended for the elements in the compos- 
ite score were based on the following:+ 

The most heavily weighted element is to be the 
average Fitness Report Score computed from Fitness 
neports subsequent to last promotion. Approximately 
half of the total score will be contributed by Fit- 
ness Reports, This heavy weighting is justified 

on the grounds that past performance over an ex- 

tended period of time is the best indication of prob- 

able future performance. This can be thought of as 
reflecting largely performance in his speciality. 

The GMST is to receive half the weight of 

the average Fitness Report score, The welght given 

this test is justified on the grounds of its being 

based on a standardized test measuring knowledge 


of those military subjects prescribed for all marines 
of that grade. This can be thought of as reflecting 
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marine . 
Time in grade will also recelve half the weight 
vhe avetuge Fibmee feypocs foune. The weight 
this clement is justified on the grounds that 
exmporience in grade contedbutes toward aqualilfica- 
tion for higher grade. 
Time in ser ovice will receive a small weight, 
abouts one-sixth of time in prade. This weighs is 
justified on the grounds that sone qualifications 
ave gained during service in lower grades, but 
primarily because it is belleved that Lone: service 
ghould receive some reward. 
Industrial promotion oyatems and their operation are 
not directiy applivable She avy. Advancements in indus- 
try fron worker to supervisory levels are usually made within 
departments. Ho large corporation in the United {tates pro- 
moves Lbs men on a world-wide besis az does the Nevy--uhich has 
men céerving in CUnins, the United Stetes, arm’ Europe conmpet- 
ing with cach other for advancement to the same vacancies. 
However, there have been many sigmificamt studies made 
an industry concerning the attitudes of workers toward promo~ 
tion in reiation to gob satisfaction. Almost without excep- 
tion, worker atcitude surveys find tnat opportunity for 
advancerent and promotlon-on-werlt rank hich anornes those 
things which men want in their jobs. In an extensive ctudy 
of one hundred theusend employees of large cornorations Lt 
was found that "certainty of promotions going to best quali- 
fied employees” was among twelve items Lnortent to job 


satinfection.* 
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1. George W. Hartmann end Theodore Newcombe, (Editors), 
industrial Conflict, “work Satisfaction,* by Goodwin 
;abson, new vork: The Cordon Compeny, 19239, p. Lis. 
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Weare NIval pwessonnel are oun the average quite young 
din die 


(most chief petty oflieers ave elimible for retirement at 
age fortc), Lt le vdgnificant to note Uhat younger workers 
in industry generally) cut mere emphesisa on Dromevicn® im con- 
nection with job satisfaction than do the colder workers. 

in stuivying factors related to morale among department 
store workers Kolstad! found that "promotion of best quali- 
fied persona” wag one of the items most closely related to 
morale. 

insofar as ean be determined, there have seen no scilen- 
tific validation studies of the Navy promotion system since 
it wav placed in crfect after VWorid Var iI. The Merine Corps 
is studying its system, which places heavy emphasis on sen- 


aper 


= 


jority, with a view to giving more weight to pencil and | 
vests ami efficiency ratings. Uniike the Navy, the Merine 
Corps has en erfective patilng system for ite enlisted pergen- 
mél in the higher gradec. In industry, che pertinent related 
studies nave clearly chowm the importance of promotions to 


morale and job satisfaction. 
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1. <A. Kolstad, “Employee Attitudes in a Department Store,” 
Journal of Applied Psychology, 22: w7o-k7g, (1938). 
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tH METHOD OF INVESTIGATION 
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The peilmary consideration in gelecting the method of 
research was that, within the limits of time end Pracilities 
aveailavie, the method selected should provide sisnificant 
infowmation relative to the questions previously cecided 
So be basic tov the problem: 

i. Does vhe Navy promotion system distinguish between 
men who aze qualified and thoue who are not? 

2. Does the Navy promotion system establish the pro- 
motion list se that the best quelified men are ad- 
yaneed in vating Tirst? 


3. If the Navy promotion system does not now promote 


tors affecting relative standing on the promotion 
list be re-welgshted so that the best qualified men 
will be promoted first? 

After preliminary surveys to determine the largest pos- 
sible sample, a group of fifteen chief aviaticn machinist's 
mater waa selected. Three officers considered qualified 
to evaluate the job performance and promotability of the men 
were chosen as judges, Using a ccembination of rating and 


ranking methods, the judges established the order in whlch 





the vi@n sitovld be pom@motecd. Fhe Wen Were given a preressi onal 
examination Por prometion end the ccor@s Were combined wLtn 
lonmth of gervicé, service wm raése, and avérds, to detemhine 
the orter tn which the Navy promotion system would Reve ad- 
vyancec them in vatine. Each of the factors centributing vo 
the multirile score war anolyced to determine the individual 
effects wunon the final relative standings. 

The use of chief vetty officers rather than first class 
petty officers is analageus to the common preetice in industry 
of using workers already on che job rather then applicants 
to validate celection orocedures. The advantege is that the 


length of time required for the validation study in shortened 


ee 


conciderably. The primary disadvantage is that it vielates 


che principle that a validstion study should be performed 
on 2 cvoup representative of the population on which the 
tests are intended to be used. This weaknecs is not fatal, 
however. On the contrary, in the initial atudy it may be 
good practice since the coefficients of correlation found 
by using personnel on the job will probabiy be lower than if 
a groun of applicants were used. Ghiselli and Brown! state: 
It ls not to be presumed, howeyer, that little 

information is gained from a validation study on 

old-established workers. Cn the contrary, it is 

aimost certain that 1f a test stands up under this 

type of validation, 1° will have even more predic- 


tive power than indicated by this group when it is 
used with a group of applicants. 





Ll. Hdwin EE. Ghiselii and Clarence W. Brown, Personnel and 
industrial Psycholoey, pp, 1735. 
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sélection Of the Criterion 





In order to ascertain whether the best qualified men 
were advanced in rating in their relative order cf qualifica- 
tions uy the Navy promotion system, 1t was first necessary 
to select a measure by wnich the relative qualifications 
of the men could be determined. Preferapiy such a measure, 
or criterion, should be objective. nfortunately, in this 
study it was found necessary to use officer ratings as a 
criterion measure after considerable research indicated that 
no other measure of abliity and promotability seemed to be 
practical. 

The primary difficuity in selecting an objective measure 
of succesz on the job was the lack of an accurate job descrip- 
tion for the rate of chief aviation machinist's mate. Those 
published by the Navy Department were unacceptable for the 
reason that they over-emphasized technical proficiency. The 
Gefinition of the aviation machinist's mate rating quoted 
on page 5 is an example. It is an accepted view in the Navy 
that a chief? petty officer's primary duty is supervision and 
that he requires technical knowledge only to the extent neces- 
gary for him to intélligently supervise and instruct others. 
"A petty officer must be firect a leader and second a specialist. "+ 

Actually, the Navy dees not yet know exactly what is 


required of the various rates. The Head of the Billet and 





1. Special Aids for Placing Naval Personnel in Civilian 
Joos, Dp. vi. 
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thus, in apite of the known wirellability of rating 
m@vhodg, merit ravings of the subyects were chosen as the 
erlterion. ‘Success in a job is depgendent not only upon how 
well the individual performs his wore, but also upon the 
attitude of his superiors toward him and his work. The truvh 


wvrAs - ‘ > te Fa de “ rt a= ry x} I~} om rhe 4 Re : 
Of the matter is that the latter is probably the best criter- 


a 


ion of success from a practical point of view, for the tu- 
perlor determines whether the man continues on his job or 


is discharged." 


Selection of the Judges and Subjects 
&n original panel of twelve officer judges was selected 
by the commanding officer of the squadron. The bases of se- 
lection were that the officers must have been on board the 
squadron for at least one year and that they must have been 


performing duties which would have brought them into frequent 








1. D. G. Price, “Present Philosophy of the Rating Structure." 
Paver read before the Board to Review Changes to the 
Rating Structure, Arlington, Va., April 20, 1949. 


Ce ~~ K. Strong, Jr., Psychological Aspects of Business, 
hg. 
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official centact with many of the aviation machinist's mates 
in the squadron. In addition to meeting these requirements, 
all of the officers chosen were of very high callbre. 

Bach of che officers was given a list of the 1195 chief 
aviation machinist's mates attached to the squadron and asked 
to indicate those whom he had observed sufficiently to rate 
on performance of duty. It was expected that about nine of 
the officers would be able to rate thirty of the men in com- 
mon. Unfortunately, it was found that only nine of the of- 
ficers could rate a total of sixteen or more men each; of 
the 119 possible subjects, only twenty could pe rated by two 
or more officers; and only fifteen could be rated by three 
officers in cornon. 

The final determination of the sise of the sample, the 
men included in it, and the Judges, was limited by the number 
of men known in common by the officers. The sample could 
have been increased te seventeen if only two judges had been 
used, and to thirty-two if only one judge had been used. 

It was felt that the use of three judges and fifteen men was 
preferable. 

Due to the method of selection, the subjects did not 
constitute a representative sample of the chief aviation ma- 
chinist's mates in the squadron. It is believed that the 
sample, with the exception of one man, was composed of the 
better-than-average chiefs. It is thought that the men were 


known by the officers because of their ability and because 





they held important joos. The one exception strengthens this 
belie?r. ‘The man appears to have been well known for his cute 


gtanding lack of ability and poor repuvation. 








CHAPTER IV 
THE CRITERION 


Establishing the Criterion 





The criterion was established by a@ combination of rating 
and ranking methods. The procedure used was developed from 
Binghan'st suggestion that the reliability of over-all rat- 
ings would be increased if the rate: first rated on specifie 
traits. 

The judges first rated the men using a Petty Officer 
Rating Seale developed by the Bureau of Naval Personnel. 

The scale is designed so that fifteen men may be rated on 

fourteen traits on one rating blank. The men being rated 

are marked together on one trait at a time. The fourteen 

tralts are divided into three areas 56 that the final pro- 
ducts of the scale aré ratings in productivity, technical 

proficiency, and leadership. 

The Petty Officer Rating Scale ratings were not actually 
used in establishing the final rank order of the men. The 
scale is experimental and has not yet been thoroughly tested 
by the Navy Department. The primary purpose in its use was 
to encourage the judges to think of the men in terms of spe- 


eific traita before deciding on their promotability. 
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1. W. V. Binghan, “Hale, Invalid and Valid,‘ Journal of 
Applied Psychology, Vol. 26, pp. 468-476, Tole. 
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TIrmediately after cormleting the rating scales, the 
judges raniced the men in the order in which they should be 
oromoted. Tne basic for the ranking was defined as perfornm- 
ance of duty as chief petty officers, with seniority taken 
into account if the Judges considered length of service to 
be important to promotabllity. 

The ranking was Gone by the methoce of comparative ar- 
rangenent described by Goodenough and Anderson.+ Each judge 
was given a name card for each of the men tc be ranked. 

Two cards were chosen at random from the set and arranged 
so that the card of the man deserving promotion first was 
to the right. The other cards were then drawn singly and 
olaced in their proper positions in relation to the others. 

The criterion was established by combining the rank or- 
Gers of the three judges. As recommended by Guilford,? median 
ranks rather than average ranks were used to determine the 
Final rank order. The men were first tentatively assigned 
the mid-most rank given by the judges. In the cases wherein 
two men received the same median rank, the man with the low- 
est average rank was given the higher standing in the pair. 

The ranks assigned to the fifteen subjects by each of 
the three judses, the median ranks, and the final ranks are 


snown in Table I. The final rank order in columm four of 














1. Florence L. Goodenough and John I, Anderson, Experimental 
Child Study, pp. 413-418. 


2. J. P, Guilford, Psychometric Methods, pp. 276~277. 
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ox the caosle was used as the cricerion ov rélacive order of 


promovabllity of the men. 


TABLS 2 


RANKS ASSIGNED BY JUDGES, MEDIAN RANKS, AND 
PINAL RANK O&8DiR LSTABLISHING CAITARION 
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___ Rankings ne Final 
Men Judze Judge Judsze Median Rank 
Ranked asia i mt Rank Order 
A 1 2 yt P| 
B L2 2 2 3 2 
C 4 2 5 4 3 
» 9 5 3 2 + 
E é 6 6 Q sz) 
F 6 if 12 G 6 
G 11 7 1 { 7 
i 3 13 ¢ ¢ o 
= 8 9 4 8 9 
J t 9 ha 8 10 
K 19 10 10 10 12 
ks 14 UP 9 le 12 
M 13 11 1% 13 13 
N 5 14 14 14 14 
Qo 15 ni IS 15 15 
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Reliability of the Criterion 

Assuming that the judsec vere equally competent as raters, 
that they knew the capabilities of the men equally well, and 
that they were judging promotabllity on the same basis, the 
reliability, orm internal consistency, of the criterion could 
be measured by the intercorrelations of the three sets of 
ranks. Table II shows the correlations between the judges 
end their average rank differences. The average correlation 
between judges was 4.36, indicating a rather low order of 


agreement among, them. 
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LHTERCORRELACT OW. OF RANK ORDERS 
ASSIGNED BY THREE JUDGES 





SST ST Br A ee SE DS RS a ee 
Judzes Correlation Average Rank 
Difference 


T-IT 5.3 
I-I1il 4.7 
LT-11TT 5.0 





However, the most that should be expected from rating 
or ranking systems in their present stage of development is 
that they will identify three groups, the high merit group, 
the group of average merit, and the low merit group. Taking 
this view, the agreemenc among judges was somewhat better. 

A study of Table ITI, page 32, shows that the subjects may 
pe divided into three sharply defined groups: a high group 
of six; a middie group of five: and a low group of four. 
These groups are separated by horizontal dotted lines in the 
table. 
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in the high group, chiefs 4, 8, 0, 0, £, and F were 
ranked sixth or better by at least two of the judges. These 
men received fourteen of the eighteen total vanks in the one 
to Six rang@--an agreemenc among judges of 78 per cent. 
Similariy, chiefs G, H, I, J, and K received 735 per cent of 


the ranks in tne seven to eleven range, and chiefs L, M, N, 
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LABLA Til 


COMPARISON OF RANK ORDERS OF THREE JUDGES 
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The assignment of ranks in the high and low ranges is 
shown graphicaliy in Figure i. Hanks in the high range, one 
to Six, are plotted above the base line and ranks in the 
Low range, twelve to fifteen, are plotted below it. The 
coneentration of high and low ranks indicates that the judges 
were in fair agreenent as to who were the better and the 


poorer men. 
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FIGURE 32. DBISTADOULION OF JUDGES ' RANKS 
IN HIGH AND LOU RANGES 

Strong* states that the rellability of a rating report 
may be measured by correlating two seta of ratings oy the 
same rater upon the same individuals with a sufficient inter- 
val of time intervening to eliminate the influence of inmme- 
diate memory. This reasoning can be extended to include 
the correlation of two sets of pooled ratings. 

Fifteen days after the first ratingeranking the judges 
repeated the procedure. The results of tne second series of 
rankings is compared with the first in Table IV. The average 
of the rank differences between the first and second rank- 
ings wes .93 anagd the rank order correlation between the two 
was £.94. The only cignificant change in renk order was 
that of Chief E who dropped from fifth to tenth nlace. 

It is realized that some authorities would not accept 
this as a measure of the reliability of the criterion since 


it may show only that the judges were remarkably consistent 














L. aT K, Strong, dr., Puychoiogieal Aspects of Business, 
AOT, 
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in their disagreement. It is 


alison nossible that fifteen days 


won not a sufficient interval to erase the effects of inmme- 


diate memory. 


TABLE LV 


COMPARTSCN OF MEDIAN RANKINGS OF THRESG 
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Rank 
pirfferense 

A A Q 
B 2 0 
C 3 Q 
D 4 Q 
E 5 5 
F 6 1 
G 

i b i 
t Q 1 
J 40 i 
x LR O 
L i2 1 
a 13 1 
N 14 @ 
6 is QO 


The most accurate inference to be drawn from the data 
ig probably that the criterion has low reliability if actual 


rank order is emphasized but that the criterion is fairly 


reliabie if 1t+ is considered to consist of three classifi- 


eations ~ high, middie, and low. 


in summary, lt was believed that the median ranks assigned 
oy 


the three officers provided a reliable metnod for dividing 


the men into three groups in order of promotability. Hence 
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Cia. 
THE PROPLSOTONAL BXNAMUNATION 


In order that the Navy promotion system misht be applied 
in a@ realistic manner, a professional examination for promo- 
tion to chief aviation machinist's mate was obtained from the 
Bureau of Naval Personnel. The examination was the one which 
haG been used in the service-wlide examinations in December, 
i949. None of the chiefs used as subjects in this study hed 
seen it previously nor had they heard any of the questions 
discussed, 

The examination consisted of 150 multiple choice ques- 
tions with four possible answers given for each question. 

It was administered in accordance with standard instructions, 
which specified a three hour time limit. However, none of 
the men required more than two hours. 

The examination covered thirteen general areas: (1) 
tools and measuring instruments; (2) airplane handling and 
checking; (3) engines; (4) propellers; (5) carburetors and 
fuel systems; (6) instruments and accessories; (7) mathematics; 


(8) alreraft construction; (9) flight operations; (10) safety 





1. "Service-Wide Competitive Examinations for Advancement to 
Chief Petty Officer, Acting Appointment.” BuPers Cire 
cular Letter No. 106-49, June, 1949. | 


\ 





, 


ww 


» 3 ae 4 f 2 ® a 
'“ t.. Les & Yo . tL é a wif S Pd. Nee aS dz ~ we DS, vw 2 ( res i Us 2b o. we = GY Oi 3 Ty 


ae ad 
Zz 
“wa 
® te 
. 
ae 
rae 


OP gen ese Lon. 
‘Loce the examination is classified as canridential 
by the Navy Department it may not be inciuded in this report. 
In order to show the general type of questions asked, however, 
three typical auestions are reproduced below, The correct 
answers are indicated by “xX. 
The instrument which shews the amount of fluid 
pressure developed in the g@av system which oper- 
ates aircraft ianding sear is the 
(X) 1. hydraulic pressure gaze 
2. hydrostatic level gage 
3. manifold pressure gare 
&, gyrostatic pressure cage 
(All men answered correctly) 
The blade angle range of the Hamilton Quick 
Peathering Hydromatic propeller is determined by 
the settings or 
‘Sp Ts, nigh and low pitch stop mings 
2. position of assembly stop pins 
3. high and low pitch stop plate 
4, index oins 
(Bight men answered correctly) 


A nine cylinder radial engine having a power 
stroke of 120 degrees will have an overlan of 


L. 20 degrees 
2 ° 30 deprees 
(x} 3. 40 degrees 
4. 60 deprees 


(One man answered correctiy) 


Examination Sccres 
The examination scores were computed on the usual Navy 


QO to 4.0 scale using the formula: 
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~ = Number of questions answered correctly, 
= Total number of examination questions. 
Tabie V lists the seores in order of eriterion rank. 
They rangea rom 7.123 to 2.91 which are equivalent to 79 and 
1609 correct answers respectively. The mean score was 2.55 
(95.7 correct answers) and the standard deviation was .24 on 


the 4.0 scale, or 9.0 on a scale of 6 to 1506 


ZABLE V 


COMPARISCH OF RANK ORDER BY PROFESSIONAL 
AMINATION SCGRES WITH CRITERION RANK ORDER 


subjects 
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A 2.61 TS i 
B 2.91 i e 
C 2.05 3 3 
D 2.53 9.5 4 
Ez 2,61 i te 
i 2.69 fy 6 
G 2.63 a f 
H 2.27 13 

L 2.19 14 g 
J 2.11 15 10 
i, 2.35 12 Li 
L 2.67 6 12 
ty = 6S 05 13 
N 7 fe “} 14 
O 2.37 11 ED 





correlation with the Criterion 
The rank order correlation between the examination scores 


and the erlterion was *.38, which is low but usable in group 
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ios ‘wave bhe complerve piccuve ef var velecbirity of vole en- 
omination. In order to be eligible for advancement, a mini-+- 
mum score of 2.5 on the professional examination is required.+ 
Table V reveals that only ten of the chiefs achieved the 
qualifying secre and that ail seven men above the median 
criterion rank of eight were among the qualifiers. Only 
three men at or below the median passed the examination. In 
other words, if the professional examination were the sole 
factor determining advancement, and if all those passing it 
were promoted, 70 per cent of the men advanced would have 
been above average as devermined by the criterion. 

In connection with the arbitrary passing grade of 2.5, 
however, i¢ should not be overlooked that none of the chiefs 
had studied in preparation for the examination. It is pos- 
Sible that had they been given an opportunity for advance 


preparation, all the men would have passed, 


item Analysis of Examination Questions 

There are three significant danger signals for any test 
item: (1) 12 all those tested give the correct answer to an 
item it may be too ecasy or 16 may be improperly constructed 
so that the correct answer is obvious; (2) if none of those 
tested give the correct answer the item may be too difficult 


or the scoring key may be in error; (3) if more men in the 











1. Bureau of Naval Personnel Manual, p. 146. 
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acvcowacted the high score proup away from the correct answer. 

A cormparison for each item was made between the five men 
making the highest examination scores and the five men malcing 
the lowest to Getermrine which ilenms actiialliy discriminated 
between the two groups. A question was said to discriminate 
if more men in the high group than in the low group answered 
it correctly. It was found that: 

(a) in 53 per cents of the items the high group answered 

correctly more often than the low; 

(o) in 33 per cent of the items there was no difference 
in correct answers between the high and low groups; 
and 

(c) in 14 per cent of the items the low group answered 
correctly more often than did the high group. 

These results would seem to indicate that only elichtyv 
of che one-hundred ang ?Pifty questions were really erfective 
in discriminating between the hich and low scores; that forty- 
nine questions added nothing to the examination; and that 
twenty-one questions actually detracted from its effective~ 
ness. 

Whether or not an item discriminates between the high 
and low groups i8 important but it is net a complete measure 


of effectiveness since it does not necessarily indicate the 
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gifrPicultcy, or oeultebilioy ef tie tres. Cutiforat denonstre ted 
that the validity of 4@ test may be seriously influenced by 
bs level of difficulty and laid down certain rules coneern- 
ing the difficulty of test items; 

Here several accepted rules apply, ruies that 

are wise on both theoretical and empirical grounds. 

Items passed by everybody or failed by everybody 

are of no value for measurement purpeses. This 

ruiec may be violated for the sake of incroducing 

one or two very easy “shock absorbers” at the hegin- 

nim of a vest. The maximun discrluination among 

testees is to be obtained by items that about one- 

haif the individuals ean pags. This ruie implies 

proportions that have been corrected for chance 

Success. 

In applying these rules to the professional examination 
lt was first necessary to correct the proportion passing cach 

vem for chance success. Since there were only four possible 

answers to each question it might be expected that any man 
having no idea which answer was the correct one would have 
one chance in four of guessing it. Therefore, it must be 
agssumec that of the vrorortion passing an item a certain 
per cent suceseded by guessing. Tabie VI, which shows the 
uneorrceted and corrected proportions used in establishing 
tne bacils for determining the level of difficulty of the 


individual test items, was adapted from Guilford .* 














1. J. P. Guilford, Pundamental Statistics in Psychology and 
Baucation, p. 293. 


@, Ibid., p. 117. 
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Musas? i ” Corrected 
Passing Proportion Proportion 
0 20 
1 ~o9 
2 OO 
3 90 
4 03 
5 «dd. 

6 220 
7 ( 29 
3 55 ‘one 
9 00 +7 
10 .O7 5 
a3 oid 64 
12 030 ‘73 
le oO 83 
14 93 OL 

15 1.00 











Because of the small sample, wide latitude was used in 
selecting the items considered to be of the proper level of 
Gifficulty. Instead of setting tne limits of the passing 
preportion near .50, an item was considered acceptable if 
che corrected passing proportion fell between approximately 
one-third and two-thirds. Referring to Table VI, this meant 
that, for practical purposes, corrected passing oroportions 
between .29 and .64 were to be accepted. Applying this meas- 
ure to the test items it was found that of the total items: 

ll per cent were passed by 2 corrected proportion 


of .G0 and were therefore useless; 
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Llc ys 
a7 ner cents were passed by a proportion of .G% to .91 
and may be considered too easy; ant 
15 per cent were passed by all and were also useless. 
These data would seem to indicate that only 27 per cent 
(41 questions) were actually “good.” This is supported by 
the fact that if the examination is considered to have cone 
sisted of only the forty-one “good” questions, the rank order 
eorrélation between the scores computed on that basis and the 
eriterion is £.35 which is not significantly different fron 
the ¢.35 correlation of the entire exemination. While these 
conclusions regarding the effectiveness of the items should 
be accented with reservations because of the smail number of 


poearsz, nevertheless, that valuable information 


er 


ey 


testees, it é 
would be obtained from an item analysis based on a larger sam- 


ple, The necessary data are available to the Navy Department. 


Reliability of Test Scores 





The reliability csefficient of the test scores was com- 
puted oy the split-half method using odd and even numbered 


test items. Rulontst formula, which eliminates the necessity 











1. P. J. Rulon, “A Simplified Procedure for Determining 
the Reliability of a Test by Split-halves," Harvard Edu- 
cational Review, 1939, Vol. 9, pp. 99-105, as quoted 
by J. P. Guilford, Pundamental Statistics in Psychology 
and Education, pp. 275-276. 
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index of réllabLliiscy, it may be considered to represent che 
proporticn of true variance in the obtained seoree. In this 
case, {C per cent of the variance in the scores mey be said 
to be “$rue variance” while 30 per cent of the variance is 


"error varieonce, 
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serving in the Bavy.+ 


Correlation with the Criterion 

Regardless of the fact that their own promotions are 
based on seniority to a large extent, and they would not 
have it otherwise, many officers in the Navy maintain that 
length of service should not be weighted heavily in enlisted 
advancements. The Bureau of Naval Personnel Nanual, Gebelin, 
and Price all warn against promoting men on the basis of 
service .2 

Tne fact is that length of service appears to have the 
highest correlation with promotability of any of the factors 
infiuencing promotion under the present system. Referring 
to Table VIL, the rank order correlation between length of 
service and the criterion was 4.46. ‘The largest rank dif- 
ference between length of service and the criterion was twelve 
in the case of Chief C. It nappens that C's length of serv- 
ise does not accurately reflect his experience. Sefore en-~- 


listing in the Navy during the war he had six years' experience 














1, A. L. Gebelin, "Promotions, Examinations and Changes 
in Rate and Rating of Enlisted Personnel, USN, November, 


1949, Ps 9, 


2. Bureau of Naval Personnel Manual, p. 144. 
Gebelin, | Op. sit. , a 
Price, Op. e174 iJ 6 es 
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ing the examination score. if this were true there should 


be @ significant correlation betveen examination seore and 


load 


length of service. It was found that the correlation between 
the examination scores of the fifteen chier eviation machin- 


a5t's mates and their years of total service was zero. 


Effect of the Limitation on Length of Service 


snmemovevinneetibearageonn 








As stated previously, credit is given for not more than 
twenty yeers' service for advancement purposes. This is 
probably predicated on the assumption that the relationship 
between length of service and service worth may be non- 
linear. it seems logical that early years of experience are 
the most valuable, For example, as a& man progresses from 
one years' experience to five years' his value to the serv- 
ice gnould increase very rapidly but, after a certain point, 
Gach addltional year cf experience probably adds less and 
jess to his service worth. 

There is sti1l1 another argument for limiting credit al- 
Lowed for length of service. This is that if a man has a 


great deal more service than his competitors for prometion 
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than the vheoy of decreasing service worth with length of 


Wndie the presents cystem hes G& limitation in thaory, it 
Goes not operate in practice. AS a5 seen im the case of 
the group sbudied, only one man was affected vy the service 
Limttatbion and he 163% only the smaii amount cf one-fourth 
wear. Since the group's average service was greater than 
that of all chier petty officers in she Navy, it is reascn- 
able to conelude that the length of service limitation has 


no practical effect om the premoticn syatem eat the present 


time. 


service in Present Hate 

The service in rate of each member of the greup studied 

shown in Vable VIII. The average service in rate was 

6.59 years. The average for all chief petty officers in the 
Navy was not availabie for comparison but it is interesting 
to note the results of the December, 1948 examinations which 
showec that the average first class petty officer advanced 
to chie?r petty officer after approximately four and one-half 


years' service in grade. 
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As might be expected, service in rate correlated highly 
(/f.82} with total naval service and somewhat lower (/.34) 
with the criterion. Service in rate is a part of total serv~ 
ice and both measure the same characteristic - probably ex- 
merience, One cannot be separated from the other. it does 
not seem reasonable to sive both factors weight in determin- 
ing order of promotion. Although service in rate appears 
to be gsiven weight in the Navy promotion system, the iimita- 


tions placed upon it render 16 unimportant in practice. 





Fffect of the Limitations on Service in Rate 


| 


Por purposes of promotion to chief petty officer rates, 


credit is allowed for a maximum of five years’ service in 
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CHAPTER VIT 
OTHER FACTORS APPECTING PROMOTION 


Medals and Awards 

The promotion system allows credit for twenty different 
medals and awards ranging from the Medal of Honor to the 
Wavy Good Conduct Medel. Area campaign medals, victory med- 
als, and similar swards ere net included. ‘tith the exception 
of the Good Conduct Medal, credit is given only for awards 
for heroism or exceptionelly meritorius service. 

rach medal 16 assigned 3 voint value according to its 

status but a candidate for premotion may claim a maximum of 
five points only, regardless of the number of awards he may 
have. A Medal of Honor is worth five points while a Good 
Conduct Mecal is worth only one. 

With the possible exception of those who have won med- 
als, no one seviously pelieves that there is a posi tive RE 
lationship between awards and promotvabpiiity. This belter 
is supported by the data presented in Table IX, page 52. 
fhe correlation between awards and the criterion was 4,18 
which is not significant. 

There are two other important facts to be noted in the 
table, The first is that the median award score was three 
points: and the other is that the minimum award score was 


a 


two pointe. Since credit for avards is limited to five 





92 
een any two of the men was 


threee points and the difference vetween the maximum and me- 


pointe, che maximum difference betw 


dian scores was two points. Two or three points are of rel- 


atively minor importance in the determination of the final 


order of promotion. 


TABLE IX 


AVARD SCORES® AND RANK ORDER OP FIFTEEN 
CHIEF AVIATION MACHINIST'S MATES 








oo SE ORRLS SS WTS NIE 
4 WAYPC Rank 
QO Lf 2 
5S 14 2 
B 6 3 
A u 5 
F 4 5 
I 4 5 
Dp 3 10 
G 3 10 
H 3 10 
J 5 Ai 
L 3 LO 
Ki 5 36 
N 3 19 
C 2. 145 
K 2 14.5 


ee en 


a. Awa scores are based on instructions con- 
tained in “Report of Examination for Advance~- 
ment or Change in Rating," NavPers 624 

(revised 6-49), 


288% Baccery ycores 


very Navy enlisted man is administered 4 basic battery 
of four aptitude vests: the general classification test 


which is an inteliiigence test designed to measure ability to 





a 
think, to learn, and to understand instructions: an arith-~ 
metic test degigned to mea.ue camputational accuracy and 
aoLiicy to use numbers in practical probiema; a clerical 
aptitude test designed to measure speed and aceuracy in cler~ 


eal work: and a mechanical test designed to measure poten- 


js 


tiality for work of a mechanical nature and familiarity with 
mechanical and clectrical principles and onerations. 

Although the test hpattery has not been validated for 
any criterion other than success in training schools, naval 
officers have been led to place an almost blind faith in the 
test battery scores as oredictors of suceess on the job, 
Particular importance has been attached to a hish general 
classification teat score as the earmarx of a man of super- 
jor apllity. ‘what moat officers do not realize is that a high 
dearee of intelligence may be nearly as undesirable as too 
low 2a degree, and that success in a great variety of oceupa- 
tions has no relationship to intelligence, 

There is alse a general belief thnt general classifica~- 
tion test scores correlate significantly with profesaicnal 
examination sradec. Some officers wouid go so far as te 
base promotions on intelligence test scores. The Navy has 
fallen victim to the greatest danger in psychological test- 
ing ~ overselling. 

The data presented in Table X do not support the Navy's 
general beliefs. There is no significant correlation between 


any of the basic test battery scores and the criterion. 
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TABLE X 
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BASIC TEST BATTERY SCORES® OF FIFTEEN 
CHIEF AVIATION MACHINIST'S MATES 
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Tne correlation between mechanical test scores and pro- 


G 


fessional examination scores was found to be £.40 which sug- 


gests that the two tests may, in pars, be measuring the same 


y 


thing. Unfortunately, this relationship must be viewea with 
suspicion because there is doubt whether the mechanical test 
scores of the men are comparable. In December, 1946 the 

"“mechenical aptitude test" in the basic battery was replaced 
by the present “mechanical test." The scores of some of the 


men in the group are based on the old mechanical aptitude 
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and bhe professional examination 1s valid only to the extent 


tad 


that she scores on the two m@echanical teste are comparable, 


Years of education of the fifteen men ranged from eight 
to thirteen with a median of eleven. It is interesting that 
the five men ranked highest by the orficers had a total of 
fifty-two years' education, the next five had a total of 
fifty-five years, and the low five had a total of fifty-six 
years, The only man with any college training was unanimously 


ranked lowest by the officers, 


Ky 
; 
3 


The average age of the croup was 34.6 yeers. The cor- 


relation between age and the criterion was £.45 and the cor- 


relation between age and length of service was 4.60, Ahile 


4 


9 


it is impossible to separate the factors of age and length 
of service, it seems obvious that the cheracteristice measured 
by leneth of service, whetever it mar be, is impertant to 


promotability in the Navy. 
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TABLES XI 
METHOD OF COMPUTATION OF MULTIPLE SCORES 
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Paotors Multipliers Maximus 
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Professional Score (G6 to %) 
Examination {2 decimals} ; 80.00 


5 dw We eee a5 
Total Nevel Years 


Service (2 decimals) 26.00 


service in Years 
Present Rate (> decimals) iO 5.00 
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Final Multiple 110.06 





some critics of the system erroneously believe that 


these maximums represent tne weignts assigned to the several 
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1. “Report of bxaminavion for Advancement or Change in 
nating,’ NavPers 6242 (Revised 6-49), 
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each measure is known or can be ectimated. For a large popue- 
nation, the runge of the factors in the promotion multiple 


ray pe estimated as Poliows: 

1. Frofessional examination. The minimum qualifying 
geore is 2.50 and the maxintum possible score La 
4.0, The estinated range is 1.50. 

2. otal navel service. The mimimm service for elig- 
tility for advancement to chief petty officer is 


¢ * ‘ id é.. ‘ ~ sillien £. 5 - ~ oe 
Six years und che maximum credit allowed is twenty 


>. Serviee in rate. The minimwm service in vate for 
uvancement to chief petty officer is three years 
and the maximum credit allowed is Pive years. The 
estimated range is 2. 
4, Awards. It may be assumed that any man otherwise 
eligibie for advancement to chief petty offleer 
would have earned at least one Good Conduct Medal 


which vould give hin a minimum award score of one 
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the system were epplicd te &@ population whose ecores were 


distributed over the entire coesible ranges. 


TABLE Mit 


WRIGHTS CF PACTORS CONTRIBUTING TC PAOMOCTICN 
MULTIPLE COMPUTED FROM ESTIMATED RANGES 
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Examination 0 3G OG 
Total Naval 
Service 2 14 28 
Service in 

Present Rate 
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Totals 50 1606 
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Multiple Scores 
The multiple scores for the fifteen chief? aviation machin- 
ist's mates are presented in Table XIII. The scores were 


computed using the formula explained in Tabie XT in which 
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The range of the several factors contributing to the 


multinole may be determined by a study of the above table. 


The ranges are important because they indicate the relative 


effect of each of the factors on the final multiple sccre. 


These ranges are: 


Professional 
Pocal naval service: 


examination: 


Service in present rate: 


Awards: 


£7? , 
Vocals 


53.20 - 42.20 
20,00 -” S.' a 
0 - 4&, 


16.0 
11.25 
0.92 

al) 


31.17 
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ubes tO une votal Lange wo, Gc Guomuidered as the approximate 

welgeht of the factor in the multaole score. The per cent 
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once only those men scoring 2.5 or higher on the pro-~ 
fessional examination ere considered qualified for advance- 
ment, the weights of the factors should be computed from the 
renges of the seores of the cuslified men only, rather than 
from the total ranges. The eccres of Chiefs H, I, J, K, and 
O should be eiimineted from the computation since they have 
no effect on the final standings of the cualified candidates. 


The ranges and the per cent weights then become: 





Professional 
examination: 58,20 - 50.60 = 7.60 = 35% 

Totel naval 
service 20.00 - 8.75 * 11.25 = 51% 
Service in rate: 5.00 ~ 5.00 = 0,00= &% 
Avards : 5,00 - 2,00 = 3.00 = 144 
Totals 68.20 - 66.35 = 21.55 «= 100% 


the effects of the various fectors may be seen more 
readily in Table XIV which shows the changes in rank order 


for the ten qualifying men as each factor is added to the 
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PABLt XIV 


CHANGES IN RANK ORDER AS FACTORS ARE 
ADDED TO MULTIPLE 


Rank Order Rank after Rank after 
Sub ject Professional botal Naval Awerd Soore 
Examination Service Added Adéed 

‘ 7 c 2 
5B i 1 L 
C 3 8 9 
D 9.5 5 o, 
E 7 & 2 8 
¥ ? t 3 
G 2 4 bh 
L 6 6 6 
i 9.5 10 19 
NW 4 7 t 








Correlation with the Criterion 

The final rank order of promotion of the chiefs, as 
determined by their multiple scores, is shown in the last 
column of Table XIII, page 59. The rank order correlation 
between the multiple seores and the criterion ranks was 
f.61. This correlation includes all fifteen men regardless 
of whether or not they attained the minimum passing score on 


the professional examination. 
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Biiieclency of the Promotion System 

Ghe correlation coefficient of £.61 between the criter- 
ion and the multiple seore ranks indicates that the Navy pro- 
motion syatem snould be very useful in ceeup prediction. 
hows that for sawmill selection ratios the aysten 


1.8 very efficient. 
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a. The selection ratio is the ratio of the number to be 
promoted to the number cf candidates for promotion. 
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would select a, B, wit F, all of whom are in the high 40 per 
oent of the criterion. if five men were to be promoted ~ 2 
selection zvatio of .33 - Gil thope selected would rank above 
the criterion median. If it were desired tc sromote 411 the 
above average men, seven would be cnosen. Tne promotion 
System vould select five nlsh men and two from the low group, 
an efficiency of 71.5 per cent. Even if the selection ratio 
were increased to .6C (nine men to be promoted), the group 
selected would be composed of all the men above the criterion 
median plus two from the low group. 

It is important to note that the promotion system does 
not seem to work in reverse. That its, while it is efficient 
in selecting the best men, it does nov do an equally good 
job of rejecting the socrer ones. While the low group of 
five, according to the multiple ranks, consists entirely of 
men at or below the criterion median, only one man in the 


judges! low group of four is ineluded. 
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ee 


en to determine whether the promotion system was cap- 


able of seleating the best men for advancement. Jt was pro- 


posed to 


we * 


find the answers to chree questions: 

Does the Neve promotion systen distinguish between 
the men who are quelifiled and those whe are not? 

Does the Navy sromotion system eatablish the promo- 
tion list so that the best qualifled men are advanced 
in pating first? 

If the Navy promoticn system does not now promote 

the best qualified men first, can the several fac- 
wore affecting relative standing on che promotion 
iist ve re-weighted so that the best qualified men 


will be promoted first? 


ane Navy Promotion System. There are ¢ignt basic steps 


which every Navy man must complete prior to advancement in 


patinyg,. 
he 
2. 
3. 


These are: 
Length of service. 
Marks requirements. 


Completion of training course. 





a. Course at a Bervice cchos.. 

53 Practical ractors. 

GS. Recommendation by cormanding officer. 
7. Examination in military requirements. 


S, Profeastonal examination. 

4 analysis tndicated that only two of Uhnese sveps, 
length of service, and the professional examination had any 
real effect in determining standing on the promotion list. 
Promotions are also influenced somewhat oy conduct. 

the Method of Investigation. The study was limited to 
promobion to the rate of chief aviation machinist's mate. 
The basic program of investigation consisted of selecting a 
group of fifteen chief aviation machinist's mates and three 
officers qualified to Judge the men on job performance and 
promotabililty. The criterion was the vank order-of-merit 
established by the judges. The men were given a professional 
xamination and their scores were combined with length of 
service, service in rate, and awards to determine the omer 
in which the Navy promotion system would have advanced them 
in rating. 

In establishing the criterion by the consensus of judges! 
rankings, 1% was found that while the agreenent among judges 
as to the actual rank order of the men was not fish, the 
Judges vere in about 75 per cent agreement as to the men in 
the high, middle, and low groups. 


The Professional Examination. The professional examina- 


tion used in the study had been previously used in the Navy 





somwice-witic competition in Becemer, 19490. IC was» en ob- 
jective cype examimation concistimg of 150 multiple ehpie 
cuestions. Although the wank order correlation between che 
exumination scores and the eriterion was only #.38, a11 seven 
of the men above the orlterion medien pacsed the examination 
while only three of tnese below che median passed, 

fn item enalysic of the examination questions indicated 
that the examination was subject to considerable inmorovement. 
Only about e7 per cent of the questions were at the proper 
Level of difficulty for the groun tested and only 53 per cent 
of the questions actually discrininated between the high and 
low test score groups. The reliability of the exenination 
was found to be .70 which is barely acceptable. 


Le 


un Of Service and Are. The lensth of service of 





the chief petty officers in the group ranged from 6.75 years 
to 20.95 years, averaging 14.2? years, The correlation be- 
ceween length of service and the criterion was found to be 
7.46 which was the highest correlation with promotability of 
any of the factors influencing order of promotion. Service 
in vate was found to correlate 4,34 vith the criterion but 
the iimitvations placed upon service in rate in the multiple 
computation render it unimportant in determining the order 
of promotion. 

It was found that age correlated “.49 with the criterion 
ang ¢,62 with length of service. This would seem to support 
the fact that leneth of service is more important to promote 


ability in the Navy than has been thought in the past. 
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Medals and Awards. The correlation between awards and 
the eriterion was found to be £.18 which is not statistically 
significant. However, the limitations placed upon the number 
of multiple points which may be claimed for awards reduce this 
factor to one of minor importance in the promotion system al~ 
though awards for good conduct and herolsm do have some ef- 
fect in determining the order of promotion. 

Test Battery Scores. With the exception of a £.43 eor~ 
relation between the mechanical test and the professional 
examination scores, none of the basic test battery scores 
correlated significantly with either the criterion or the 
professional examination. 

selection Efficiency of the Promotion System. The rank 
order correlation between the multipie scores and the cri- 
terion was *#.61. In the case of the group studied, if the 
selection ratio is kept small, the promotion syatem will 
select the better men for promotion with considerable ac- 
curacy. If the selection ratio is .33 or less, all those pro- 
moted would be from the above-median group of the criterion. 

Although the system selects the top men with efficiency, 
it does not do an equally goed job of rejecting the men in 
the lower range of the criterion. That is, the promotion 
System will select a small group of good men for advancement 
but if will not select a small group of poor men for 


demotion. 
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weighting of Factors in the Promotion Multiple. The 
weighting of the several factors contributing to the promo- 
tion multiple depends almost entirely upon the scores of the 
group under consideration. By using estimated ranges to 
determine approximate weightings, it was shown that the pro~ 
fessional examination and length of service could be expected 
to contribute 51 per cent and 36 per cent respectively to 
the final multiple. However, a study cf the ten high mul- 
tiple scores in the group showed that the professional exam- 


ination contributed only 35 per cent to the multiple, while 


length of service contributed 51 per cent. 





Limitations. In drawing conelusiona from this study of 
the group of fifteen chie? aviation machinist's mates certain 
limitations must be recognised. First, the group studied 
aid not constitute @ representative sample of chief aviation 
nachinist's mates in the Navy and, second, the sample was 
very small. While the following coriclusions apply specifi-+- 
cally only to the group studied, the selectivity or the pro- 
motion systen could be expected to increase if it were 
applied to a group with a wider range of talent. The find- 
ings of this study should be taken as evidence to he con- 
firmed or refuted by further research. 

Discrimination Between Guallfted and Non-qualified Men. 
The first question to be answered was: Does the Navy pro- 


motion system distinguish between the men who are gualified 
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and those who are not? In the srou studied only one man, 
Chief Oo, was considered by the Judges not to be qualified 
as a chief petty officer, While the system can not ve said 
to have definitely set him apart from the others, it did rank 
him as number fourteen in the group of fifteen. In addition, 
according to Navy standards, he failed the professional ex- 
amination and would not have been promoted regardless of his 
multiple score, 

Four other men, all considered qualified by the officers, 
aiso failed the examination. Although the five men designated 
as not qualified by the system all ranked at or below the 
eriterion median, it does not appear that the promotion sys-~ 
tem, as it operates, distinguishes accurately between the 
qualified and the non-qualified. This is because the burden 
of determining qualification for promotion is placed on the 
last step of the system. If the promotion system were better 
administered only those qualified for promotion would be 
allowed to compete for advancement. The unqualified would be 
eliminated by a previous siep. 

Promotion in Order of Qualifications. The second ques~ 
tion to be answered was: Does the Navy promotion system estab- 
lish the promotion list so that the best qualified men are 
advanced in rating first? From the standpoint of the indi- 
vidual the answer seems to be no. The promotion system is 
not sufficiently valid to be used for individual prediction, 


But how does one determine who is the best man? It will be 





rc 
receilled tnat the officers agreed only on groups, not on 
individual vanings. 

Prom the standsoint of group selection, however, the 
system is very erficlent in promoting the best qualified men 
so long aS a reasonably small selection ratio is used. Com- 
pared with the selection procedures cenerally used in industry, 
the Navy vcromotion system is excellent. 


of Factors in the Promotion Multiple. The 





third question to be answered concerned the possible re- 
weighting of che factors comprising the multiple so that the 
selectivity of the system might be improved. So long as the 
present scoring system is in use it wiil be impossible to pre- 
determine the weights for the several factors because the 
weights are dependent upon the distribution of scores for the 
particular group in question. It would appear from their 
correlation coefficients that the most effective practical 
weights for the factors would be: length of service, includ- 
ing service in rate, 50 per cent; professional examination, 
4O per cent: and awards, 10 per cent. In order to give pre- 
determined weights to the factors, the use of standard scores 
is necessary. 

inadequacy of Navy Job Specifications. In analyzing the 
Navy promotion system, particularly in connection with estab- 
lishing the criterion of promotability, it was evident that 
the Navy does not have adequate job specifications. A thor- 
ough job analysis must be the first step in setting up any 


system of personnel selection. It is understood that the 
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favy 22 now undertaking 2 lergpe scale scientific bplilet anal- 
weis. Until these etudiee are complete vhe recommendations 
of tre ciawssifteation cirrieers whe prefess the alility to 
place, transrer, and promete persennel on the basis cf match- 
ins chilis ageinst Jeb requirements should be viewed with 
reservavions. 


weacershiy., The most glaring deficiency of the Navy 


promotion system ic that 1¢ does not take leadership into 
account. As it is designec, it appears that the promotion 


system for chief? petty officers places too much emphasis con 
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vechnical pro 
importance of Length of Service. Probably the most 
important conclusion that can be drawn from the study of the 
group of chief aviation machinist's mates is that length of 
service, or seniority, is the best single measure of promote 
ability. This is not to be construed as a recommendation 
for promotion by seniority alone but it may be construed as 
questioning the wisdom of those who would accomplish reduc- 
tion in the number of chier petty officers in the Navy by 
forced retirement of the older men. 

Prorvessional Examination Construction. Although the 
atem analysis of the proftessgional examination was made with 
avery small sample, it is a foreed conclusion that the exan- 
ination was not well constructed. 

Usefulness of the Navy Promotion System. As a final 


conclusion, it should be stated that while the promotion 
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Recommendations 

scientific Job Analysis. The Navy promotion system needs 
the firm foundation of an accurate and scientific job analysis. 
The work now being done in this area shouid be given the 
highest priority. It is important not only to promotions but 
to all phases of naval personnel administration. 

Petty Officer Rating Scale. The Navy urgentiy needs a 
new rating system for evaluation of enlisted personnel. The 
Petty Officer Rating Scale used in this study has the char- 
acteristics of a good scale and should meet this need. Howe 
ever, no rating scale, no metter how well constructed, can 
be used successfully uniess the rating officers are properly 
trained and indcectrinated with the importance of accurate 
ratings and kmow the men being rated. 

Practicel Factors. The vsefulness of practical factors 
as they are oresently administered is doubtful. As job anal- 
yses for the various rates are completed, the practical fac- 
tors should be revised to insure that they are, in fact, 
prectical, realistic, and pertinent. 

improvement of the Professional Examinetion. The pro- 
fessional examinations for advancement in rating should be 


improved in a technical sense, An item analysis should be 
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be devised te mneesure the ieadership abliity of proupective 
petty officers. The Navy recognises tne vital importance of 
leagerchip in ite men but, ab present, iesdership piaye no 


mari in the promotion gysten except as if may be related to 


pp 
Lensth of service and technical preficiency. 


pugeestions for Further Research 
nelationship Between Seniority and Service Worth. In 


many Navy ratings there is an excess of men in tne chief 
petty officer grade. In order to xeep promotion channels 
open if will be necessary to reduce these excesses in some 


vtituds in the Bureau 
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manner. There seems to se a growing : 
of Naval Personnel that a desirable sten in reducing the 
excess of chief petty officers would be the forced retire- 
mens of the older men - those with more than twenty years' 
service. The results of this study indicate, however, that 
there may be a nigh correil on between length of service 
and service worth, Therefore, before any action is taxen 
to separate the senior men from the cervice, the relationship 
between seriority and value to the service should be defi- 
Ately determined py further selentific research. It would 
be tragic, indeed, if the Navy Lost its better men through 


action unsupported by readily obtained facts. 
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